Making statistical significance more significant

Statistical significance: is it really that significant?

Trap of trends to statistical significance: likelihood of near significant P value becoming more significant with extra data.

When faced with a P value that has failed to reach some specific threshold (generally P<0.05), authors of scientific articles may imply a “trend towards statistical significance” or otherwise suggest that the failure to achieve statistical significance was due to insufficient data. This paper presents a quantitative analysis to show that such descriptions give a misleading impression and underm...

MODERNISING THE POLICY PROCESS Making policy research more significant?

In an increasingly complex world of interrelated problems many governments have tried to modernise their institutional structures and the ways in which they go about making policy. In the UK and elsewhere this has been most apparent in the growing emphasis given to evidence-based policy making in contrast to faith-based approaches and the conviction politics of earlier periods. Much of the deba...

More accurate tests for the statistical significance of result differences

Appears in the 18th International Conference on Computational Linguistics (COLING 2000), pages 947-953, Saarbrücken, Germany, July, 2000. cs.CL/0008005 Statistical significance testing of differences in values of metrics like recall, precision and balanced F-score is a necessary part of empirical natural language processing. Unfortunately, we find in a set of experiments that many commonly used...

Statistical significance and clinical significance.